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Technical  Section 

Collective  knowledge  bases  (CKBs)  allow  knowledge  from  a  multitude  of  sources  to  be 
effieiently  gathered,  integrated  and  deployed.  Markov  logie  provides  a  representation  language 
and  learning  and  inferenee  algorithms  for  CKBs.  The  goal  of  this  projeet  was  to  develop 
solutions  to  several  problems  that  need  to  be  addressed  before  CKBs  ean  be  widely  deployed, 
ineluding:  tightly  eoupling  learning  and  inferenee,  learning  many  levels  of  strueture,  finding 
eomplex  mappings  aeross  representations,  optimizing  joint  inferenee,  explaining  the  results  of 
inference,  and  aeeepting  natural  language  input. 

•  We  developed  Tractable  Markov  Eogie  (TME),  an  expressive  subset  of  Markov  logic  where 
inferenee  is  always  traetable,  and  whieh  therefore  potentially  makes  reliable  large-seale 
probabilistie  knowledge  bases  feasible  for  the  first  time. 

•  We  developed  sum-produet  networks,  a  representation  for  propositional  probabilistie  models 
where  inferenee  is  always  traetable,  and  learning  algorithms  for  it.  (This  work  won  the  Best 
Paper  Award  at  UAI-1 1 .) 

•  We  developed  the  first  fully  general  probabilistie  theorem  proving  teehniques,  building  on 
our  work  on  formula-based  inferenee. 


We  developed  approximation  by  quantization,  a  new  approaeh  to  probabilistic  inference 
based  on  quantizing  the  levels  of  a  potential  when  it  beeomes  too  large. 


We  developed  a  new  algorithm  with  theoretical  guarantees  for  learning  tractable  Markov 
networks. 

We  developed  a  new  class  of  methods  for  approximate  probabilistic  inference,  based  on 
compilation  of  models  to  arithmetic  circuits. 

We  extended  USP  (our  system  for  extracting  knowledge  from  text  without  supervision)  to 
build  and  populate  ontologies,  by  clustering  extracted  objects  and  relations  into  multiple 
levels  instead  of  just  one. 

We  developed  new  formula-based  approach  to  MLN  inference.  This  greatly  scales  up 
inference  by  eliminating  and  conditioning  on  formulas,  instead  of  variables.  Our  system  was 
a  co-winner  of  the  2010  UAI  Approximate  Inference  Challenge. 

We  scaled  up  MLN  inference  and  learning  by  using  “coarse  to  fine”  techniques,  which  take 
advantage  of  an  ontology/type  hierarchy  to  successively  refine  the  inference  while 
minimizing  computational  cost  and  maximizing  approximation  accuracy. 

We  developed  online  inference  techniques  for  MLNs. 

We  developed  approximate  lifting  techniques  for  MLN  inference. 

We  developed  a  new  approach  to  learning  MLN  structure,  using  random  walks  to  greatly 
improve  efficiency. 

We  developed  the  first  bottom-up  approach  to  learning  Markov  network  structure. 

We  published  a  book  on  Markov  logic,  synthesizing  the  research  of  the  last  few  years. 

We  developed  an  MLN  and  learning  and  inference  algorithms  for  unsupervised  semantic 
parsing.  Our  USP  system  extracts  a  knowledge  base  of  logical  formulas  from  raw  text 
without  any  annotation  or  supervision,  and  uses  it  to  answer  questions.  USP  generalizes  our 
earlier  approach  to  unsupervised  coreference  resolution  by  resolving  arbitrary  constituents 
(not  just  noun  phrases),  and  doing  so  compositionally.  (This  work  won  the  Best  Paper  Award 
at  EMNLP-09.) 

We  generalized  our  lifted  belief  propagation  approach  to  a  wide  variety  of  inference 
algorithms  (e.g.,  variable  elimination,  junction  trees,  satisfiability,  etc.),  and  developed  an 
approximate  version  of  it  that  further  improves  efficiency. 

We  developed  LHL,  an  algorithm  for  learning  MLNs  over  entities  and  relations  identified 
using  our  earlier  SNE  algorithm. 

We  extended  Markov  logic  to  incorporate  decision  theory,  and  developed  an  algorithm  for 
choosing  the  actions  that  maximize  expected  utility. 


•  We  developed  a  state-of-the-art  approaeh  for  unsupervised  eoreference  resolution  in  text 
using  Markov  logic.  This  is  one  of  the  first  unsupervised  approaches  to  coreference,  and  the 
first  one  to  match  the  accuracy  of  supervised  approaches  on  standard  corpora. 

•  We  developed  SNE,  a  system  for  extracting  semantic  networks  from  the  Web  based  on 
Markov  logic.  SNE  takes  candidate  tuples  extracted  by  TextRunner,  jointly  clusters  the 
objects  and  relations  in  them,  and  outputs  the  resulting  semantic  network  (concepts  and 
relations  among  them).  This  is  the  first  system  of  its  kind. 

•  We  developed  a  series  of  efficient  algorithms  for  inference  in  Markov  logic. 


Awards  and  Honors 

•  Hoifung  Poon  received  a  Ph.D.  degree  in  summer  2011  for  his  dissertation  “Markov  Eogic  in 
Machine  Reading”. 

•  Best  Paper  Award  at  ElAI  2011  for  “Sum-Product  Networks:  A  New  Deep  Architecture,” 
Hoifung  Poon  and  Pedro  Domingos,  authors. 

•  Pedro  Domingos  was  elected  a  Eellow  of  the  Association  for  the  Advancement  of  Artificial 
Intelligence  in  2010  for  significant  contributions  to  the  field  of  machine  learning  and  to  the 
unification  of  first-order  logic  and  probability. 

•  Vibhav  Gogate  and  Pedro  Domingos  won  the  PR  track  (estimating  the  partition  function  and 
probability  of  evidence)  and  placed  second  in  the  MAR  track  (marginal  estimation)  at  the 
2010  Elncertainty  in  Artificial  Intelligence  Approximate  Inference  Challenge. 

•  Stanley  Kok  received  a  Ph.D.  degree  in  spring  2010  for  his  dissertation  “Structure  Teaming 
in  Markov  Eogic  Networks”. 

•  Daniel  Eowd  received  a  Ph.D.  degree  in  winter  2010  for  his  dissertation  “Efficient  Teaming 
and  Inference  in  Rich  Statistical  Representations”. 

•  Best  Paper  Award  at  EMNLP  2009  for  “Unsupervised  Semantic  Parsing,”  Hoifung  Poon  and 
Pedro  Domingos,  authors. 

•  Invited  column,  “Solving  AI:  We  Need  a  New  Eanguage  for  Artificial  Intelligence,”  by 
Pedro  Domingos  in  Technology  Review,  March/ April  2009  Vol.l  12/No.2. 

•  Parag  Singla  received  a  Ph.D.  degree  in  winter  2009  for  his  dissertation  “Markov  Eogic: 
Inference,  Teaming,  Applications,  and  Extensions”. 


Patent  Filings  or  Patent  Awards 

There  were  no  patent  filings  or  patent  awards  resulting  from  this  grant. 
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